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MINIMIZATION TECHNIQUES 
USING RATIONAL APPROXIMATIONS 


By John Engvall 
SUMMARY 

The purpose of this paper is to present a curve fitting 
method using rational approximations. Curve fitting prob- 
lems arc frequently encountered here at the Manned Space- 
craft Center. Polynomial approximations are used for a 
major portion of these problems because of the simplicity 
in applying polynomial least squares techniques directly 
to any set of data. Polynomial approximations are not 
accurate enough to be acceptable in many cases. The method 
developed In this paper Is superior to the best least 
squares polynomial approximation for a large class of 
curves. It is well known that low order rational approxi- 
mations are often as accurate as high order polynomial 
approximations (Ref. 1). Considerable computer time can be 
saved by using the low order rational approximation if a 
large number of points must be calculated. The rational 
approximation method derived herein can be applied to any 
set of data Just as easily as least squares polynomial tech- 
niques. However, matrix inversion must be used to obtain 
the final result. This can, in some cases, result in 
undesirable round off errors which can lessen the accuracy 
of the method. 
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LIST OF SYMBOLS 


{x^ } ; i = 1,N discrete set of values for independent 

real variable 

{y^} ; i = 1,N corresponding set of values for dependent 

real variable- 

T 

A transpose of a matrix A 

A 1 inverse of the matrix A 

K + 1 number of parameters in minimization 

technique 

{ a ^ } ; i = 1,K the K parameters to be obtained for 

minimization 

INTRODUCTION 

The basic problem of curve fit.ti ig l is to formulate 
an analytical expression to replace a discrete set of data 
points. The analytical expression can then be used to 
interpolate and/or extrapolate. The need for interpolation 
and extrapolation occurs in numerical integration, data 

*The problem of curve fitting is restricted here to a dis- 
crete set of points because this is the major concern of 
this paper. In general the problem is extended to an 
infinite number of points (Ref. 2 ). 
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reduction, and engineering problems using experimental data. 
Examples are radiation intensity curves, the derivative of 
atmospheric density with altitude, and guidance control func- 
tions. Analytical expressions are preferred because compu- 
tations of the analytical expression takes less time and 
fewer locations in memory than table look up procedures. 

There are two aspects of curve fitting: (1) the 

smoothing of noisy data, and (2) the fitting of exact data 
points by an analytical expression. Only the latter aspect 
is discussed in this paper. If the data is exact then table 
look up procedures are usually more accurate near the original 
points . 

GENERAL STATEMENT OF THE PROBLEM 


A curve fitting technique can be automated in the 
following manner: 


If (1) 

{x.} i = 1 , 2 , . . . , N is a discrete set of 
independent real variables 

( 2 ) 

{y(x i ) } i - 1,2,...,N is the corresponding 


set of dependent real variables. 

Then choose 

the following: 

( 3 ) 

f(x,a,K) c F 

( 4 ) 

1 | f (x . ,a,K) , y(x . ) | | I! 

J J j = 1 

( 5 ) 

< ^1 IfUj ,a,K) , y (Xj ) | |^ ^ 
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Whore P is a class of functions involving K + J 
arbitrary parameters (a 0 , a 1} ...,a^) = a and the functional 
form of f is specified. 

(*0 ||f,y|| is the norm of f(Xj, a,K) , 

y(x^), j=l,...,N which measures the accuracy 
of f . 

(5) is an automated minimization technique which 

determines a such that (^J) is a minimum. 

Thus, if (1), (2) and K are determined, the auto- 
mated technique obtains a particular a , such that for the 
class of functions F , f(x,a,K) is the most accurate 
function with respect to the norm chosen in (*l). The 
choice of the norm is discussed by Rice (Ref. 3 )» 

The major disadvantage of the automated technique is 
that the data points might be of such a form that, regardless 
of the choice of K , the best approximating function from 
the class F is not acceptable to the user. This usually 
stems from the practical numerical problems involved in 
the minimization technique rather than from the theoretical 
basis . 


LEAST SQUARES POLYNOMIAL APPROXIMATION 

Least squares polynomial approximations are automated 
as follows: 

(1) F is the class of polynomial of the form 


a 0 + a iX + ... a j^x 


K 


f(x,*,K) 


• • 



(2) 1 | f ( x , , a , K ) , y ( x 1 ) I | 1 j » £ )0t » K) _y(x j ) ) 


If K is fixed, 
A = U^} 


uj" 1 } 


,T, 


i = 1,2, . . .N 

j ^ 1,2, ...K + 1 


If a minimum exists and A A is non-singulc r , then 
there exists a unique a such that (2) is minimized. In 
this case a is given by 

a = (A T A)-‘ A 1 ' y(x ) . 

J 





RATIONAL APPROXIMATIONS 


The objective of this method is to obtain a rational 
approximation y(x) to a discrete set of data points 

y (x ) = f (x , a , K ) / f(x, e,m) 

Milne (Ref. 1) has shown that certain classes of functions 
are better approximated by rational functions than by 
polynomials. Moreover, there are physical problems which 
are characterized by an underlying mathematical model which 
is of rational function form, (for example, the aerodynamic 
lift of a fiat plate (Ref. 3))- However, for problems 
which do not have a rational function as an underlying model, 
the method in no way assures the best rational approxima- 
tion with respect to the least squares norm. 


METHOD 



(1) Given a discrete set of N data points 
(y(x i ), Xj i = 1,2,..., N} choose an integer K and 
apply a least squares polynomial approximation to the data 
such that 


E ^p(x 1 ,a,K) - y(x i )^ 


is a minimum. 


(2) Choose two integers m , n such that n < K , 
m + n + 2 < N . 

(3) S^lve for the two polynomials p(x, £,m) , p(x, 6,n) 
such that 

N / ^2 

^p(x i} e,m) y(x a ) + p(x., 6,n) - p(x j[ ,a,K)y (1) 

is a minimum. 


(*l) The approximation for y(x) is ga.ven by 

y(x) = ^p ( x , a , K ) - p(x j 6,n)j / p(x, e,m) (2) 


The minimization of (3) can be obtained very simply 
as follows: 

Let A = {a, , } such that 
J 
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1 y(x i ) 



j = 1,2,. . . ,m + 1 

i = 1,2, ... ,N 


_ _ Y j-(m+ 2 ) J = m + 2,...,m + n + 2 

a ij X 1 1 = 1,2, . . . ,N 

T 

If A A Is nonsingular then the solution is unique and is 
given by 



Theorem: If there exists a rational function such that 


y(x i ) = P (x i ,r , K) / p(x i ,e,m) (3) 

i = 1,2,. ,.,N 


then the preceding method is exact (to within round off 
error), provided m = K - 1 
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Proof: 


If 

to 


p (X , a , K ) *,S t M 1 r?i t r i s 

y(x^) tlfeSn COJiHi iirr 5, 



mrw iflii 



Then 




pTx, 4 , 8-1) - p(*t 


thus, there ex'. u p(x, - - 1) m; ?. 


p(x, «. K - 1) - p ( X , « ,K ) 


- jr* ru^v) 


Also consider S, i ■ 1 r 
such ^hat 

64 - 


r. 

» 

K 


r.. C 1 


Thus, there exists p(x,fc,m) *v<c: lhb\ 


«x 

p(x, i>,m) - - — ~ p(x , t *n) 

r K 


But this implies that, by [1) 
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l>(x,t>,n) y(x) * p(x, d, K - 1) - p(x,a,K) 




- zr" p(x,r,K) + ~r p(x,r,K) = 0 

1 K r K 


Thu* , 

H 

f 

The isJnimuj# sum of the squared residuals is zero. 


N / 

If'*, 

1 - 1 \ 1 


»e,n) y(x.) + p(x i , d, K - 1) - p(x 




c 


CONCLUDING RF MARKS 


= 0 . 








i ‘hi:- than using the least squares solution p(x,a,K) 

jf 

ft; .n-arting point, the polynomial p(x,a,K) = x' could 
t' used. This will assure a v - ? 0 . However, if the least 
squares polynomial solution Is used as a first attempt to 
fit t :.e data, then p(x,. ,a r K) i = N , will already 

be computed to obtain the deviation for the curve.. If 
a. t 0 then the rational approximation can be incorporated 
wltu tne polynomial approximation program. The following 
procedure has been used satisfactorily. Set K equal to 
one. Obtain the best least squares fit of degree one. 

Choose several values of m , say one through five. Obtain 
the rational approximation for ea^h of these values. This 
yields several different approximations for one value of K . 
If these are not acceptable then a range of values for K 
can be used. The rational approximations should be plotted 
cut at a large number of points between the input data 
points because of the possibility of singular points. 
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